V 



United States Patent m 

Hale et aL 



US005412421A 

[ii] Patent Number: 
[45] Date of Patent: 



5,412,421 
May 2, 1995 



[54] MOTION COMPENSATED SENSOR 

[75] Inventors: Robert A. Hale, EUicott City, Md.; 

Harvey C. Nathanson, Pittsburgh, Pa. 

[73] Assignee: Westinghonse Electric Corporation, 
Pittsburgh, Pa. 

[21] Appl. No.: 122,134 

[22] Filed: Sep. 15, 1993 

Related U.S. Application Data 

[63] Continuation of Ser. No. 876,596, Apr. 30, 1992, aban- 
doned. 

[51] IntCL« H04N7/18 

[52] U.S.CL 348/208; 348/147 

[58] Field of Search 358/105, 109, 110, 113, 

358/125, 126, 222; H04N 7/18; 348/113, 144, 
164, 162, 145, 147, 326, 208, 345, 699, 701, 373 

[56] References Cited 

U.S. PATENT DOCUMENTS 
3,261,014 7/1966 Diaz 358/110 



3,638,502 2/1972 Leavitt et aL _ - 358/222 

4,245,254 1/1981 Svensson et aL «... 358/222 

4,516,158 5/1985 GraingeetaL « 358/109 

4,788,596 11/1988 Kawakami et aL „ „ 358/222 

4,912,770 3/1990 Seto et al 358/109 

4,959,725 9/1990 Mandle „ „ .. 358/222 

5,060,074 10/1991 Kinugasa et aL .„ 358/222 

5,109,249 4/1992 Kitajima „ 358/222 

5,155,520 10/1992 Nagasaki et aL - 358/222 

5,166,789 11/1992 Myrick 358/109 

5,317,394 5/1994 Hale et al „ - 348/208 

Primary Examiner — Howard W. Britton 
Assistant Examiner — Richard Lee 

[57] ABSTRACT 

A sensor produces signals corresponding to positions of 
objects within a field of view over time. A motion de- 
tector is provided for determining movement of the 
sensor. Signals from the sensor and the detector go to a 
processing unit which causes an appropriate modifica- 
tion of the signal received from the sensor to compen- 
sate for the movement. 

9 Claims, 2 Drawing Sheets 
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the lens to compensate for such movement. We prefer 

MOTION COMPENSATED SENSOR to utilize an infrared detector in our sensor. 

We also prefer to provide a internal navigation sys- 
This application is a continuation of application Ser. tern which establishes a reference plane in the internal 
No. 07/876,596, filed Apr. 30, 1992, now abandoned. 5 navigation system. The sight lines of all sensors are at 
BACKGROUND OF THE INVENTION known relative positions with respect to the reference 

plane. Whenever vibration or other motion occurs to 

1. Field of the Invention change the sight line of a sensor the navigation system 
This invention relates to a sensor which when subject provides a reference for adjusting the output of the 

to motion or vibration adjusts its output accordingly. 10 sensor to compensate for the movement which has oc- 

2. Description of the Prior Art curred. 

Various types of sensors have been used to record We also prefer,to provide a normalizing means for 
events occurring at a selected location over time. These adjusting the output signals received from the sensors, 
sensors could be anything from video cameras to infra- Normalizing means is preferably used to compensate for 
red detectors. Typically, the sensors produce analog l $ variations in output among sensors. The nonnalizer can 
signals corresponding to the scene which they observe. compensate for signal strength variations and signal 

The analog signals are digitized to create digital images 6^° among the sensors. 

of the scene. Those digital images can be stored in a Other objects and advantages of the present invention 
memory, displayed on a screen or directed to a variety w ^ become apparent from a description of the certain 
of processing systems which may either extract infor- 20 preferred embodiments of the figures. 

^TpSfSS £££ ^ b ^ BREEF DESCRn ™* OF THE FIGURES 

One or more sensors may be mounted to a host plat- FIG. 1 is a diagram of a present preferred embodi- 

form. When several sensors are used their signals must mcnt . °* m our scnsor navigation system illustrating 

often be combined to generate a useful image. In some 25 Positioning of toe sensor relative to the target, 

situations sensors must be mounted on platforms which *? G " 2 is a sidc view of a present preferred sensor 

flex, vibrate or move in any direction. All such types of which has been cut awav t0 show ma j° r components of 

motion in any degree shall be hereinafter called move- our present preferred sensor. 

ment Platform movement can cripple efforts to com- , A . FIG ' 3 B a . thematic view similar to FIG. 1 showing 

bine signals from sensors that are mounted on the mov- 30 ^ t " set WIthm the field of of the 

ing platform. For example, a 100" per second motion DESCRIPTION OF THE PREFERRED 

would move scene data across 1 16 pixels if each deteo EMBODIMENTS 

tor's Instantaneous Field of View (TJFOV) is 150 ttr and t> *■ - * * 

the integration time is 0.01 seconds. Vibration levels can „ u R^^S to FIG. 1 we provide a sensor 1 having a 

reach 10 pixels, peak to peak on common aircraft plat- 35 ^ i "?** ? * 

forms. Hie resulting loss of signal to noise ratio as well ^SS^£TS ^ V ?™1? 5 J*?* 

as spatial information is a major problem. ^Typjcally, the field of view 

Intra-sensor alignment is important for tracking and ^2 ^1*1* ^ 8 

clutter discrirnmation! Relating data to a common iner- 40 ~ ^^I*™** * mo ^ d ^ to J 12 on 

tial reference frame is also important for "pointing" 40 ^^^^''T^^S^ ° f 

t ^^+i ™«. * _ F * F ^ platform 0 and sensor 1 mounted thereon. A processing 

targeting systems accurately. For multiple sensors sen- ^ 20 directs the sensor through line 14 Thes^r 

ah fr ent r ,S SenS °^ mU3t *° g^erates a signal which b oulp\t over iS iTa^d 

maintained in relative alignment to one another or the through ^tal convertorU lie dtetized ste- 

signals from them must be corrected to account for any 45 ^ J| y be difecteTmto a me^ory^g^S^r, 
misalignment which occurs. Moreover, the signals from screen or other device. A memory 21 co^cted^The 

vTtt'T , mtegrate f ^ nor r hZed ? t/ da ; P rooessin S »* 20 programs for directing Z 

tively short tuie to account for overlaps » fields of senS or and for utilizing signab reeved from the sensor, 

view among the sensors, and movement of sensors re- One program adjusts thecal according to detected 

suiting from vibration or movement of the platform on so motion oTvibration of the sensor 

which the sensors have been mounted. We have found that in many sensor systems, signal 

■ Consequently, there is a need for sensor which can outputs can vary among sensors looking at the same 

detect and compensate for motion, flexure and vibra- image, it is, therefore, necessary to normalize the sig- 

tion. Such sensors should also be either positioned or nals so that any given point will produce the same signal 

movable to cover a wide field-of-regard. 5 5 from every sensor. Accordingly, we provide a normal- 

SUMMARY OF THE INVENTION ' zer 30 for makia 8 such corrections. The nonnalizer 
... ., , , usually would have a processing unit and memory 
We provide a sensor capable of detecting and com- which contains a program. The program would have 
pensatmg for flexure, vibration and other motion of the algorithms for modifying the digital image in accor- 
platform on which it is mounted. We provide a motion 60 dance with a predetermined sequence. The predeter- 
detector on the sensor. The motion detector detects mined sequence may be developed by testing the sen- 
vibration and directional motion, hereinafter called sors and determining variations in output among sensors 
movement" of the sensor. We also prefer to provide a based upon that testing. We also prefer to provide a 
means for adjusting the sensor in response to detected navigation system 26 connected to processing unit 20. 
movement of the platform holding the sensors. In the 65 The navigation system generates a reference plane 27. 
present preferred sensor we provide a lens having a We can consider that reference plane to be parallel to 
servo motor. The servo motor is activated in response the X-axis in direction indicator 29. If one considers line 
to detected movement Then the servo motor adjusts 28 from the target 50 to the reference plane 27, we see 
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that line 28 is at some angle 0 from a vertical line pass- 
ing through navigation plane 27. When sensor 1 is in 
alignment with the navigation system sight line 8 will be 
at some known relative position with respect to plane 
27. In FIG. 1 sight line 8 is parallel to plane 27. Hence, 
a line from target 50 passing through the sight line will 
produce the same angle 6 relative to a line perpendicu- 
lar to sight line 8 and corresponding angle <f> between 
line 28 and sight line 8. See FIGS. 1 and 3. If sensor 1 is 
moved because of vibration or movement of the plat- 
form to which the sensor is mounted, angle 6 will 
change. Since the reference plane 27 remains in the 
same position, it is necessary to adjust for the change in 
angle 9. Before such an adjustment can be made, how- 
ever, one must determine the amount of movement of 
sensor 1. This is accomplished through the use of mo- 
tion detector 12. As shown in FIG. 2 the motion detec- 
tor preferably contains a gyroscope 32 and accelerome- 
ter 34. The motion detector 12 generates a signal which 
passes along line 33 to processing unit 20. We prefer 
also to provide a second line 35 from the motion detec- 
tor to a servo motor 36. The servo motor 36 responds to 
the information received from motion detector 12 by 
adjusting lens 5. This can be done by turning support 37 
on which lens 5 has been mounted. Within the detector 
1 we provide a sensor surface 4 which generates a signal 
in response to light passing from the scene through lens 
5. That signal is directed along line 16 to the processing 
unit. The detector is mounted on platform 6. One may 
provide an additional servo motor 40 controlled by the 
processing unit 20 through input 42. Servo motor 40 is 
used to make major changes in the position of the sensor 
1. 

Thus, our sensor may compensate for motion, flexure, 
vibration and other motion in any or all of at least three 
ways. The sensor could be moved with servo motor 40. 
The sensor lens 5 can be changed. These changes can 
occur in addition to adjusting the signal emitted from 
the sensor. Consequently, should our sensor be moved 
or vibrated, a useful signal will continue to be gener- 
ated. 

Although we have shown certain present preferred 
embodiments of our image detection and tracking sys- 
tem, it should be understood that our invention is not 
limited hereto, but may be variously embodied within 
the scope of the following claims. 

It is claimed: 

1. A sensor capable of sensing objects within a field of 
view about a sight line having a known relative posi- 
tion, the sensor producing signals corresponding to 
positions of objects within the field of view at a given 50 
time comprising: 

a) a housing; 

b) a sensor surface which produces sensor signals in 
response to at least one of light waves and radio 
waves striking the sensor surface; 55 

c) a detector mounted on the housing which can 
detect movement of said sensor and emit signals 
corresponding to detected movement of said sen- 
sor, 

d) at least one processing unit and associated memory 60 
containing a program for adjusting said sensor 
signals in response to detected movement of the 
sensor, the processing unit connected to the sensor 
surface and the detector for receiving said sensor 
signals from at least one of the sensor surface and 
the detector and modifying the sensor signals re- 
ceived from the sensor surface in accordance with 
signals received from the detector; 



e) adjustment means for moving at least a portion of 
the sensor in response to detected movement of the 
sensor, and 

f) an internal navigation system which establishes a 
reference plane at a selected distance from the sight 
line of said sensor, the internal navigation system 
being connected to the adjustment means for ad- 
justing the sensors to maintain a desired spatial 
relationship between, the reference plane and the 
sight line of the sensor. 

2. The sensor of claim 1 wherein the detector com- 
prises at least one of a gyroscope and an accelerometer. 

3. The sensor of claim 1 also comprising a lens at- 
tached to the sensor and the adjustment means and 
wherein the adjustment means comprises a motor for 
moving the lens. 

4. The sensor of claim 1 wherein the internal naviga- 
tion system which establishes a reference plane, is con- 
nected to the processing unit 

5. The sensor of claim 1 wherein the sensor surface is 
capable of sensing at least one of visible light, infrared 
light and radar signals. 

6. The sensor of claim 1 also comprising normalizing 
means connected to the sensor for normalizing signals 
received from the sensor. 

7. The sensor of claim 6 wherein the normalizing 
means comprises a processing unit and associated mem- 
ory containing a program for modifying the signals in a 
desired manner. 

8. The sensor of claim 7 wherein the normalizing 
means adjusts the signals to normalize for one of signal 

30 gain and variation in output among sensors. 

9. A sensor for use with a navigation system which 
establishes a reference plane, the sensor being capable of 
sensing objects within a field of view, about a sight line 
having a known relative position relative to the refer- 
ence plane, the sensor producing signals corresponding 
to positions of objects within the field of view at a given 
time comprising: 

a) a housing; 

b) a lens attached to the housing through which the 
sight line extends and positioned to direct at least 
one of light waves and radio waves onto a sensor 
surface; 

c) a sensor surface which produces sensor signals in 
response to said at least one of light waves and 
radio waves striking the sensor surface; 

d) a detector mounted on the housing which can 
detect movement of said sensor and emit signals 
corresponding to detected movement of said sen- 
sor; 

e) adjustment means for moving .the lens in response 
to said detected movement of the sensor to main- 
tain the known relative position of the sight line 
relative to the reference plane; 

f) at least one processing unit and associated memory 
containing a program for activating said adjust- 
ment means and adjusting said sensor signals in 
response to said detected movement of the sensor, 
the processing unit connected to the sensor surface, 
adjustment means and the detector for receiving 
said sensor signals from at least one of the sensor 
surface and the detector and modifying the signals 
received from the sensor surface in accordance 
with signals received from the detector, and 

g) an internal navigation system which establishes a 
reference plane at a selected distance from the sight 
line of said sensor, the internal navigation system 
being connected to the adjustment means for ad- 
justing the sensors to maintain a desired spatial 
relationship between the reference plane and the 
sight line of the sensor. 
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